Resource Offload Consolidation Based on Deep-Reinforcement Learning Approach in Cyber-Physical Systems
نویسندگان
چکیده
In cyber-physical systems, it is advantageous to leverage cloud with edge resources distribute the workload for processing and computing user data at point of generation. Services offered by are not flexible enough against variations in size underlying data, which leads increased latency, violation deadline higher cost. On other hand, resolving above-mentioned issues devices limited also challenging. this work, a novel reinforcement learning algorithm, Capacity-Cost Ratio-Reinforcement Learning (CCR-RL), proposed considers both resource utilization cost target systems. CCR-RL, task offloading decision made considering arrival rate, device computation power, transmission capacity. Then, deep model created allocate based on communication rate. Moreover, new algorithms regulate allocation among servers. The simulation results demonstrate that method can achieve minimal latency reduced compared state-of-the-art schemes.
منابع مشابه
Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm
: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...
متن کاملAdaptive embedded control of cyber-physical systems using reinforcement learning
Embedded control parameters of cyber-physical systems (CPS), such as sampling rate, are typically invariant and designed with a worst case scenario in mind. In an over-engineered system, control parameters are assigned values that satisfy system-wide performance requirements at the expense of excessive energy and resource overheads. Dynamic and adaptive control parameters can reduce the overhea...
متن کاملResource-aware control for cyber-physical systems
An efficient usage of available resources is a substantial requirement for the successful control design in cyber-physical systems. Recent results indicate major benefits of event-based control compared to conventional designs, when resources such as communication, energy, and/or computation, are scarce. In this work we consider multiple control loops which share the communication resource. We ...
متن کاملReinforcement Learning Based PID Control of Wind Energy Conversion Systems
In this paper an adaptive PID controller for Wind Energy Conversion Systems (WECS) has been developed. Theadaptation technique applied to this controller is based on Reinforcement Learning (RL) theory. Nonlinearcharacteristics of wind variations as plant input, wind turbine structure and generator operational behaviordemand for high quality adaptive controller to ensure both robust stability an...
متن کاملVision-based Deep Reinforcement Learning
Recently, Google Deepmind showcased how Deep learning can be used in conjunction with existing Reinforcement Learning (RL) techniques to play Atari games[11], beat a world-class player [14] in the game of Go and solve complicated riddles [3]. Deep learning has been shown to be successful in extracting useful, nonlinear features from high-dimensional media such as images, text, video and audio [...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE transactions on emerging topics in computational intelligence
سال: 2022
ISSN: ['2471-285X']
DOI: https://doi.org/10.1109/tetci.2020.3044082